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ABSTRACT 

Based on the broader needs for long-term studies of 
the effects of instructional treatments, for behavioral objectives, 
and for learning hierarchies, this research investigated differences 
in the effect on learning and rate of forgetting when students are 
informed of the behavioral objectives and learning hierarchy. It was 
expected that students who were informed of the behavioral objectives 
of an activity would perform higher on achievement and retention 
posttests. Nine null hypotheses were tested, using 88 elementary . 
education majors divided into four groups. Students were classified 
according to their ability levels and each group received different 
information concerning the use of the self-instructional text 
material. Posttests were administered immediately on completion of 
the unit to compare the degree of learning, and after 2 weeks to 
compare the rate of forgetting. Analysis of variance was used in 
evaluating the data, and results showed that of the nine hypotheses 
formulated, the data supported two--that the four treatments result 
in different 'rates of forgetting, and that the differences in 
over-all performance scores resulting from the four treatments are 
not identically reflected at each ability level. A further study is 
being prepared in a typical classroom situation without the use of 
self-instructional materials. (MBM) 
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Introduction 

A principal goal of the curriculum-reform movement 
is increased learning and retention. There have been many 
research studifes conducted to determine the effects of vari- 
ous manipulative variables on learning and retention. Many 
of these studies have contrasted the effect on achievement 
and retention of different classroom materials and different 
methods of instructing the student in the classroom. Although 
such efforts have been extensive, in a recent journal article 

V 

entitled "On the Assessment of Retention Effects in Educa- 
tional Experiments” Kenneth H. Wodtke (1) of The Pennsylvania 
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State University made a plea for an even greater emphasis on 
long-term follow-up measures in studies of the effects of 
instructional treatments. He argued that there is a need 
for the investigation of instructional treatments spe- 
cifically designed to facilitate such long-term effects. He 
pointed out that, even though some instructional variations 
might be of little value in facilitating the amount of, 
learning, these same variations might have their primary 
effects on long— term retention. That is, an instructional 

treatment might produce relatively inefficient learning, but 

/ 

greater resistance to forgetting than some other treatments • 
Advocates of behavioral objectives for education, 
such as Gagn6 (2), Mager (3), Walbesser (4), and Popham (5) 
have called for more specific statements of purpose and 
expected outcomes in new curriculum development. The Ameri- 
can Association for the Advancement of Science has developed 
a curriculum entitled Science— A Process Appro ach (6), in 
which the objectives of the curriculum are stated in terms 
of what the student is to do rather than in terms of verbal- 
izable knowledge that the student is to know. Behavioral 
descriptions of the objectives of curriculum has become basic 
to some new proposals for curriculum revision and development. 

The Teacher Education Project, sponsored by the 
Division of Elementary and Secondary Education Research, 
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U.S. Office of Education, is a multi-phase project which has 



as its objective the production of model programs for the 
training of elementary school teachers, itfine sets of spe- 
cifications for elementary teachers education programs were 
produced in 1968 by nine universities in Phase X of this 
project* In each set of design specifications, the objec- 
tives of the curriculum model were described in behavioral 
terras. The sponsoring agency expects that the future imple- 
mentation phase of this project will produce demonstration 
institutions which will bring about the improvement and 
updating of elementary education across the country. If the 
existing model programs produced in Phase I are utilized, a 
key dimension of the updating of elementary education will 
be the use of behavioral objectives. 

Another dimension of curriculum, design which has 
beguh to play an important role in new curriculum develop- 
ments is the construction of learning hierarchies. Gagn£ 



has hypothesized that intellectual skills that are learned 
. . . have an ordered, relation to each other, such 



that subordinate ones contribute positive transfer 
to superordinate ones [7] , 

Gagn£ refers to learning sequences which exhibit such 
ordered relations between the behavioral objectives as 



learning hierarchies. There have been several recent 
researches reported which investigated the problems of 
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hierarchy construction and behavioral description of learning 
outcomes. Among the recent contributions to this literature 
a:.,e those by Gagn$ (8,9), Walbesser (10,11,12), Walbesser 
and Carter (13), Engel (14), Smith (15), Baker (16), and 
Cook (17,18,19). 

The Question 

It is in the context of these three points, 1) need 
for long-term studies, 2) need for behavioral objectives, 
and 3) need for learning hierarchies, that a study was con- 
ducted by the author to investigate the question: 

If a group of students is informed of the behavioral 
objectives and the learning hierarchy of a unit of 
instruction and another group of students receiving the 
same unit of instruction is not so informed, will there 
be differences in effect On learning and rate of 
forgetting?. 

The study differs from those reported in the literature by 
the point of emphasis, While utilising the results of 
earlier research, the author’s research shifts the emphasis 
from the benefits to be derived from the instructor knowing 
the objectives and the learning hierarchy to the bgaggjfegjfeo 
be derived from informing the student of ..t he ..b^hasoorad 
ob jectives and the learning 'hierarchy . It was expected 'that 
those students who are informed of the behavioral objectives 
of an activity will perform higher on achievement and 
retention posttests than those students who are informed of 
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the activity's place in a hierarchical learning sequence 
(designed after Robert Gagnes cumulative learning model) 
in addition to being informed of the behavioral objectives 
of the activity will perform higher on achievement and 
retention posttests than those who are informed just of the 
behavioral objectives of the activity. 



Rese arch Hypothesis, 

The study was designed to determine whether for a 
specific population with specific treatments data could be 
obtained to support the above expectations. Nine null 

i * 

hypotheses related to the following research hypotheses, 

associated with the initial question and reflecting the 

stated expectations, were tested by the experiments 

Research Hypothesis I s Giving students statements 
of the behavioral objectives (with, examples) before 
each activity of an instructional unit (T^) results 
in higher achievement scores for the students so 
informed than those students who are given no 
information beyond the actual instruction unit 

activity (T^) . 



Resear ch Hypothesis 2 : Giving students copies of 

the learning hierarchy (with examples) of sequence 
cells at the beginning and at the end of an 
instructional unit (Tj results in higher achieve- 
ment scores for the students so informed than for 
those students who are not given any information 
beyond the actual instructional ixnit activity (T^) . 



Research Hypothesis 3 : Giving students statements 

of the behavioral objectives (with examples) and 
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copies of the learning sequence before each activity 
of an instructional unit (T ) results in higher 
achievement scores for the students so informed than 
for those who are not given any information beyond 
the actual instructional unit activity (T^) . 



Research Hypothesis 4 s Giving students statements 
of the behavioral objectives (with examples) and 
copies of the learning hierarchy before each activity 
of an instructional unit (T^) results in higher 
achievement scores for students so informed than for 
students who are given only statements of the . 
behavioral objectives (with examples) before each 
activity of an instructional unit (T^) * 



Research Hypothesis 5 : Giving students statements 

of the behavioral objectives (with examples) and 
the learning hierarchy before each activity of an 
instructional unit (T ) results in higher achievement 
scores for students so informed than for students 
who are given on3~y copies of the learning hierarchy 
with examples of sequence cells at the beginning and 
at the end of an instructional unit (T^) . 



Research Hypothesis 6 ? The differences in achievement 
scores resulting from the four treatments are not 
identically reflected at each ability level. 



H ypothesis 7 s The four treatments have 
differential effects on the over-all performance 
of students. 



Research Hypothesis 8 : The four treatments result 

in" different rates of forgetting. 

Research H ypothesis 9 : The difference in over-all 

performance scores resulting from the four treat- 
ments are not identically reflected at each ability 
level. 
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Experimental Procedures 
Eighty-eight elementary education majors in a 
four-year college were blocked on ability levels and randomly 
assigned to four treatments. While receiving different 
information about the behavioral objectives and the hier- 
archical learning sequence, all four groups received the 
same set of self— instructional text material covering a, 



mathematical unit of instruction. 

The subjects were students enrolled in four sections 
of the second semester of a two-semester sequence mathematics 
course for elementary education majors at Towson State 
College, Baltimore, Maryland in the spring of 1969. The 
students were classified according to their ability levels 
as reflected by their grades in the first semester of the 
two-semester sequence course before being randomly assigned 
‘ to the following four treatments.. The first treatment, 
listed T , is the control treatment. 

T —Self -instructional text material on a 
■** mathematical unit. 

T — self-instructional text material on a 

2 mathematical unit with the gbjectiy^ 
given before each activity m the unit. 

T —Self -instructional text material on a 

3 mathematical unit with students informed 
of the learning hierarchy at the beginning, 
and at the end of the unit. 
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T —Self -instructional text material on a 

4 mathematical unit with students informed: 

(a) at the beginning of the unit of the 
learning hierarchy for the instructional 
unit, and 

(b) at the beginning of each activity of the 
objectives of that activity and of that 
activity’s place in the hierarchic al 
learning sequence * 

The self "-instructional material for the instructional 
unit, based upon the learning hierarchy constructed for this 
study and consisting of eight activities, was administered 
by the experimentor for eight consecutive class days. After 
the completion of the instruction unit, posttests were 
administered immediately to compare the degree of learning, 
and, after two weeks, toi compare the rate of forgetting. 

For clarity, henceforth in this paper the following 
codas will be used for each of the four treatments: 

CON for T- 

OBJ for T 

B-E for 

HIER for T 

Statistical Analysis 

This study was designed to investigate several 
pair-wise comparisons among treatment group means. The 
nine hypotheses can be grouped into two areas of concern. 
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The first six hypotheses are concerned with pair-wise 
comparison of the effects of four instructional treatments 
on achievement . The last three hypotheses (H ? , H g , and H 0 ) 
are concerned with pair-wise comparison, of the effects of 
the four treatments on retention in terms of o yer— ax i, 
performance and rate of forget tincL. The treatments hy 
levels analysis of variance was employed to determine yhether 
the data of this study supported the first six hypotheses. 

An evaluation of the data in terms of the last three 
hypotheses was. made utilizing a repeated measure analysis 

design (20) . 

Findings 

The findings of this study may be conveniently 

partitioned into two areas: 

1) The effects of treatments on immediate achieve- 
ment scores obtained on an immediate posttest. 

2) The effects of the treatments on over-all 
performance and rate of forgetting as measured 
by an immediate posttest and a delayed posttest. 

Immediate Achievement 

Six null hypotheses concerning immediate achievement 
and related to the first six research hypotheses were tested 
using treatments -by-levels analysis of variance, h summary 
of the results of the treatments -by -levels analysis of 
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variance (T x L ANGVA) of immediate posttest scores appears 
in Table X. The F ratio for treatment effect was 0.56, 

,v 

while the critical value of F was 2.78 , Therefore, each 
of the first five null hypotheses was retained. 



TABLE I 

TREATMENTS -BY -LEVELS ANALYSIS OF VARIANCE 
OF IMMEDIATE POSTTEST SCORES 



Source of 
Variation 


df 


Mean 

Square 


F 


Levels of Ability 


2 


6,503*54 


~ T 


Treatments 


3 


282.09 


.56 ns 


Interaction 
(Treatments x 
Levels) 


6 


93.28 


.19 ns 


Within Cells 
(Error) 


76 


501.10 





a ~ .os 



The F ratio observed for ability -by -treatment inter- 
action effect was 0.19 . The critical value of F at 6,76 df 
and 0.05 level of significance is 2.27 . Therefore, the null 
hypothesis for the sixth research hypothesis was retained. 

The standard deviations and the cell and marginal 
means of the four treatment groups on the immediate posttest 
are reported in Table II . 
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Over-all Performance and 
Rate of Forgetting 

Over-all performance is defined as the score obtained 
when the scores made on the two posttests by a student in 

l 

the experiment axe summed. Rate of forgetting is defined 
as the change over time in the scores made on the immediate 
posttest and the score made on the same posttest adminis- 
tered after a delay of two weeks. 

The effectiveness of the four instructional methods 
on student over-all performance and rate of forgetting was 
studied using a repeated measures analysis. The findings 
relative to over-all performance and rate of forgetting 
pertain to the last three research hypotheses. 

Research Hypothesis 7 ; The four treatments have 
differential effects on the over-all performance 
of students. 

Research Hypothesis 8 : The four treatments result 

in different rates of forgetting. 

Research Hypothesis 9 s The differences in over-all 
performance scores resulting from the four treat- 
ments are not identically reflected at each ability 
level. 

A summary of the results of the repeated measures 
analysis of immediate and delayed postfcests scores is shown 
in Table III. The F ratio observed for treatment effect was 

0.37 . The critical value of F at 3,76 df and 0.05 level of 
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significance was 2*73 • Hence, the null hypothesis fox 

Research Hypothesis #7 was retained* The P ratio observed 

, r ~ 7. /Jo 

for treatment -by -posttest interaction effect was ^3® . 

jT 

Since the critical value of F at. <,76 df and 0.05 level of 

2. 7Z 

significance is JteSS M E , the null hypothesis for Research 
Hypothesis #8 was rejected. The fact that there was a 
statistically significant treatment —by— posfctests inter y- 
action indicated that the slopes of the retention curves 
for the treatment groups were different. In order to deter- 
mine which treatments resulted in the least rate of forget- 
ting, the slopes of the retention curves were plotted as 
•shown in Figure 1 based upon the data in Table IV* The 
retention curve of the control treatment CON had a negative 
slope, while the retention curve of treatment HIER had a 
slope which approached a value of sero and the retention 
curve of treatment OBJ had a positive slope. 



TABLE IV 

TREATMENT MEANS FOR POSTTESTS 



* 


Immediate 

( 


Delayed 


Treatment CON 


76.50 


72.95 


Treatment OBJ 


69.55 


73.50 


Treatment B-E 


73.09 


70.50 


Treatment HIER 


77.50 


76.80 
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The F ratio observed for level-by-treatment effect 
was 2*50 * The critical value of F at 6,76 df and 0,05 level 
of significance is 2.23 * Therefore, the null hypothesis for 
Research Hypothesis #9 was rejected* The level-by-hreatment 
interaction profiles are shown in Figure 2 . The profiles 
are based upon the data in Table V. The mean of the middle 
ability students in treatment HIER was 87.14 while the. mean 
of the middle ability students across all four treatments was 
81.01 . The means of the other two ability groups in treat- 
ment HIER did hot show as much difference bet ween their 
respective means and their means across the four treatments. 



TABLE V 

ABILITY LEVEL OVER-ALL PERFORMANCE MEANS 

FOR TREATMENTS 



Ability 

Levels 


• 


Treatments 




CON 


OBJ 


B-E 


HIER 


High 


94.25 


86.75 


94.50 


94.00 


Medium 


82.11 


00 
i — i 

i 

• 


73.33 


87.17 


Low 


58,67 


54.83 


60 . 00 


59.66 



Table VI presents the standard deviation and the cell 
and marginal means for the immediate posttest and the delayed 
posttest scores analyzed in the repeated measures analysis. 



Over-all Performance/2 




FIGURE 2 



LEVEL X TREATMENT INTERACTION PROFILES 
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TABLE VI 

MEANS, CELL SIZES, AND STANDARD DEVIATIONS 
OF IMMEDIATE AND DELAYED POSTTEST SCORES 



Levels Posttests 



Treat- of 

merits Ability Immediate Delayed 
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TABLE VI (continued) 



Levels Posttests 



Treat- of ** — ■ — ’ ‘ ' 

ments Ability immediate Delayed 
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Conclusions 

Of the nine hypotheses formulated, two were supported 
by the data. The expectations pertaining to achievement 
differences expressed in the first six research hypotheses 
are not supported by the data. Likewise, the seventh 
research hypothesis that the four treatments have differ- 




ential effects on the over-all performance of students, is 
not supported by the data. 

However, the following conclusions hold for research 
hypotheses #8 and #9: 

#8 The hypothesis that the four treatments result 
in different rates of forgetting is supported 
by the data. 

#9 The hypothesis that the differences in over-all 
performance scores resulting from the four 
treatments are not identically reflected at 
each ability level is supported by the data. 



Discussion 

Immediate Achievement . The results of the study 
appeared to be quite conclusive in terms of there being no 
observable differential effects of the four treatments on 
immediate achievement scores. The analysis of the dcfta 
provided no support for qualifying this finding on the basis 

of ability levels. 

• i 
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Over -a 11 Performance and T ^ ie 

results of the etudy indicated that if the levels of ability 
of students are not considered, then the benefits in terms 
of over-all performance to.be derived from either of the 
four treatments do not differ significantly at the 0.05 
level. . However, the presence of the significant treatments- 
by-levels interaction effect found in the study indicate 
that differences between the effects of the four treatments 
do exist within the three levels of ability, therefore, any 
predictive statement concerning the effects of the four 
treatments on over-all performance must be qualified by 
specifying the levels of ability involved. 

TFhe observed treatments -by-leve Is profiles reveal 
that giving students statements of the behavioral objectives 
of an activity accompanied by a copy of the learning hier- 
archy is more beneficial in . 

(when compared to the other three treatments) to_t he 
students in the middle ability J. ey e 1 than to those students 
in either the high or the low ability levels. It is 
reasonable to argue from this finding that the low ability 
level students were not able to assimilate the additional 
information and, thus, received no benefit from being given 
the objectives and/or the learning hierarchy. From the 
treatments -by-levels profiles, one might project that the 
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additional information about objectives actually confused 
the low ability level students* The students in the high 
ability level group apparently received no differential 
benefit from either of the treatments. One might argue in 
this case that the pre-organizing benefit possibly provided 
by the statements of the behavioral objectives and/or 
learning hierarchy were not needed. Perhaps the high level 
students were able to infer the objectives and the learning 
sequence itself- In the case of the middle ability group, 
one could assert that the objective statements accompanied 
by the learning hierarchy enabled them to gain a helpful 
perspective about the mathematical skill which they were 
ex£>ected to learn. 

The significant treatment ~by~pasttesfc interaction 
effects found by the repeated measure analysis is a second 
indication that differences in the four treatments do exist - 
This interaction effect revealed that the treatments result 
in different rates of forgetting . The more striking 
difference observed is that while the rate of forgetting 
of treatments CON and B-E show a negative gain and the rate 
of forgetting of treatment HIER showed neither gain nor loss 
of the mathematical skill, the slope of the treatment OBJ 
retention curve showed a positive gain. The findings of 
this study reveal that while giving students statements of 
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the behavioral objectives of each activity of the instruction 
unit (OBJ) did not result in relatively higher immediate 
achievement scores, the treatment did result in greater 
resistance to forgetting than the other methods of instruc- 
tion. One could reasonably argue that the students who were 
informed of the behavioral objectives were able to gain in 
ability to perform the terminal task because the combination 
of being aware of the behavioral objectives and the two-week 
period between posttests resulted in their being able to 
better assimilate the instructional material they had 
received. 

There may be several reasons that the findings of 
this study lend no support to the assertion that telling 
students the behavioral objectives and/or the learning 
hierarchy of a unit of instruction will increase their 
performance on immediate achievement tests. The author 
believes that an important reason that the data of the 
study did not support the immediate achievement expectations 
was that single-medium self-instructional materials were 
used. One might question whether supportive data would be 
obtained from a similar study conducted in a typical 
classroom situation without the use of self-instructional 
materials. The author is presently preparing to conduct 
such a study in a county school system in Maryland. 
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